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Abstract 

The Simple Genetic Algorithm, the Univariate Marginal Distribution Algorithm, the Ex¬ 
tended Compact Genetic Algorithm, and the Hierarchical Bayesian Optimization Algorithm 
are all well known Evolutionary Algorithms. 

In this report we present a Java implementation of these four algorithms with detailed 
instructions on how to use each of them to solve a given set of optimization problems. Ad¬ 
ditionally, it is explained how to implement and integrate new problems within the provided 
set. The source and binary files of the Java implementations are available for free download at 
https://github.eom/JoseCPereira/2015EvolutionaryAlgorithmsJava, 


1 Introduction 


Evolutionary Algorithms (EAs) are a group of optimization techniques inspired by computational 
models of evolutionary processes from biology, namely natural selection and survival of the fittest. 
The idea of using biological evolution as a paradigm for stochastic problem solvers has been around 
since the 1950s and it experienced major developments in the 1970s and 1980s with the emergence 
of four main independent research fields: Genetic Algorithms (GA), Evolutionary Strategies (ES), 
Evolutionary Programming (EP) and Genetic Programming (GP). Over the last two decades new 
classes of Evolutionary Algorithms have been developed, one of them being Estimation of Dis¬ 
tribution Algorithms (EDAs). Currently, EAs are a very active and dynamic research field, with 
various applications in many areas of scientific and technological knowledge. 

In this report we present Java implementations of the Simple Genetic Algorithm (SGA) ( |Hol- 
land 1975; Goldberg 1989[ Eiben and Smith[ 20031, and of three well known EDAs: the Uni¬ 
variate Marginal Distribution Algorithm (UMDA) (Miihlenbein and Paafi[ 1996), the Extended 


Compact Genetic Algorithm (ECGA) (Harik, 1999), and the Hierarchical Bayesian Optimization 


Algorithm (HBOA) (Pelikan and Goldberg, 2006). Each of these algorithms is a well known EA 


with a significant amount of published research. We encourage the interested reader to explore the 
existing rich scientific literature on the subject. 
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The Java implementations of these four EAs follow the same basie design, with similar I/O 
interfaee and parameter eonfiguration. All implementations satisfy the same set of eonstraints: 

1. The algorithm represents possible solutions (individuals) as strings of zeros and ones. 

2. All individuals have the same string size. 

3. The population size remains eonstant throughout a eomplete run of the algorithm. 

In the following, we provide detailed instruetions on how to use eaeh of the algorithms to 
solve optimization problems. A set of well known optimization problems is given and, ad¬ 
ditionally, it is explained how to implement and integrate new problems within the provided 
set. The souree and binary files of the Java implementations are available for free download at 
https://github.eom/JoseCPereira/2015EvolutionaryAlgorithmsJava, 

The implemented set of standard EAs presented in this report is also the basis for 
the Java implementation of the Parameter-less Evolutionary Algorithms as diseussed in an¬ 
other arXiv report and whose eorresponding souree is also available for free download at 
https://github.eom/JoseCPereira/2015ParameterlessEvolutionaryAlgorithmsJava, 


2 How to use the code 

Herein we provide detailed instruetions on how to use a Java implementation of the generie algo¬ 
rithm EA, where the aeronym is a mere plaee holder for the algorithms SGA, UMDA, ECGA, and 
HBOA. 

The EA is a Java applieation developed with the EelipseQlDE. The available eode is already 
eompiled and ean be exeeuted using the eommand line. 

Run the EA from a command line 

1. Unzip the souree file 2015EAs.zip to any direetory. 

2. Open your favourite terminal and exeeute the eommand 

cd [yourDirectory]/2015EvolutionaryAlgorithmsJava/EA/bin 

where [yourDirectory] is the name of the direetory ehosen in step 1. 

3. Exeeute the eommand 

java com/EA/EA EAParameters.txt 

The argument “EAParameters.txt” is in faet the name of the file eontaining all the options 
eoneeming the parameter settings and ean be ehanged at will. 

After eaeh exeeution of a single or multiple runs, the EA produees one output file - EA_*_*.txt 
- that reeords how eaeh run progressed in terms of fitness ealls, best eurrent fitness, among other 
relevant information. Additionally, the EA also ereates the file - EA-STATS-*-*.txt - that stores 
some of the statisties neeessary for analyzing the behaviour of the EA over multiple runs. 

'Version: Kepler Service Release 2 
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2.1 Set of optimization problems 

The current code includes a set of optimization problems that can be used to test any of the four 
EAs. Here is the problem menu: 


ZERO Problems ONE Problems 


0^ 

ZeroMax 

10-^ 

OneMax 

1 ^ 

Zero Quadratic 

11 ^ 

Quadratic 

2 ^ 

Zero 3-Deceptive 

12^ 

3-Deceptive 

3 ^ 

Zero 3-Deceptive Bipolar 

13 ^ 

3-Deceptive Bipolar 

4^ 

Zero 3-Deceptive Overlapping 

14^ 

3-Deceptive Overlapping 

5 ^ 

Zero Concatenated Trap-k 

15 ^ 

Concatenated Trap-k 

6 ^ 

Zero Uniform 6-Blocks 

16^ 

Uniform 6-Blocks 


Hierarchical Problems 

21 —>■ Hierarchical Trap One 

22 —>■ Hierarchical Trap Two 


The Zero problems always have the string with all zeros as their best individual. The One 
problems are the same as the Zero problems but their best individual is now the string with all 
ones. A description of these problems can be found, for instance, in IPelikan et al.l (120001). The 


Hierarchical problems are thoroughly described in Pelikan (20051. 

It is also possible to define a noisy version for any of the previous problems. This is done by 
adding a non-zero Gaussian noise term to the fitness function. 

The source code that implements all the problems mentioned in this section can be found in the 
file src/com/EA/Problem.java. 

As mentioned previously, all configuration and parameter setting options of the EA are in the 
file EAParameters.txt. 

To choose a particular problem the user must set the value of the following three options: 

Eine 81: problemType 
Eine 90: stringSize 

Eine 107: sigmaK (defines the noise component) 


2.2 How to implement a new problem 

The EA uses the design pattern strategy ( |Gamma et al.[ |1995| ) to decouple the implementation of a 
particular problem from the remaining evolutionary algorithm (see Eigure[^. As a consequence, to 
integrate a new problem to the given set of test problems it is only necessary to define one class that 
implements the interface IProblem and change some input options to include the new choice. The 
interface IProblem can be found in the file src/com/EA/Problem.java. We note that, the reading of 
these instructions is best complemented with a good analysis of the corresponding source code. 
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In the following let us eonsider that we want to solve a new problem ealled NewProblem with 
the EA algorithm. To plug in this problem it is neeessary to: 

1. Define a elass ealled NewProblem in the file src/com/EA/Problem.java. The signature of the 
elass will be 

class NewProblem implements IProblemf 

public float ipmyipf{ 

// 

} 

public String toString(){ 
return "NEW PROBLEM"; 

} 

} 

2. Code the body of the funetion eomputeFitness(Individual) aeeording to the nature of problem 
newProblem. The elass Individual provides all the neeessary funetionalities to operate with 
the string of zeros and ones that represents an individual (e.g., getAllele(int)). This elass ean 
be found in the file src/com/EA/Individual.java. 

3. To define the new problem option, add the line 

case 99: return new Problem(new NewProblem(), stringSize, optimumValue, sigma); 

to the switch eommand in the funetion initializeProblem() of the file 
src/com/EA/EAParameter.java. The ease number - 99 - is a mere identifier of the 
new problem option. The user is free to ehoose other value for this purpose. The rest of the 
line is to be written verbatim. 

4. Validate the new problem option value - 99 - by adding the ease problemType == 99 
within the eonditional if(optionName.equals(”problemType”)) of the same EAParame- 
terjava file. 

Although not strietly neeessary, it is also advisable to keep updated the problem menu in the 
file ParParameters.txt. 

As mentioned before, the four Java implementations follow the same basie design. In prae- 
tiee, this means that all implementations share some eommon eore Java elasses. Here is a brief 
deseription of those elasses: 

Population Contains the array of individuals that are the population. It provides all the funetion¬ 
alities neeessary for operating that set of individuals. It is also responsible for eomputing 
its own statisties sueh as average fitness and best fitness, whieh are part of the neeessary 
information to analyze the behaviour of the EAs. 

RandomPopulation Subelass of the elass Population. The eonstruetor of this elass is responsible 
for generating the initial random population. 

SelectedSet Subelass of the elass Population. For some algorithms, depending on the seleetion 
operator, the size of this set is different from the population size. 
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Figure 1: The EA uses the design pattern strategy (Gamma et al. 19951 to allow an easy imple¬ 
mentation of new problems to be solved by the framework. 


Individual Contains the string of zeros and ones that represents an individual. It provides all 
the functionalities necessary for operating that string. In particular, it is responsible for 
computing its own fitness, according to the problem at hand. 

Stopper Contains all the stop criteria used by the EAs. These criteria are integrated in a single 
function called criteria{...) which in turn must be returned by the nextGeneration() function 
in the file EASolver.java. The criteria options can be changed in the file EAParameters.txt 
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